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ABSTRACT 


Recursive  least  squares  spectral  estimation  algorithms  have  attracted 
much  attention  recently  because  of  their  excellent  convergence  behavior 
and  fast  parameter  tracking  capability.  They  are  recursive  in  the  sense 
that  as  a  new  element  of  the  time  series  is  observed,  the  parameters  of  a 
spectral  estimation  model  are  algorithmically  updated.  Recently,  a 
recursive  algorithm  for  efficiently  obtaining  an  autoregressive  (AR) 
spectral  estimate  has  been  introduced  by  Morf  and  Lee  [2].  In  this  paper 
a  more  insightful  development  of  their  technique  is  presented.  A  modifi¬ 
cation  of  the  data,  namely  prewindowing,  is  applied  to  achieve  a  significant 
computational  Improvement.  The  development  is  predicated  on  utilisation 
of  a  projection  operator. 


I.  INTRODUCTION 

In  many  relevant  signal  processing  applications,  one  seeks  to 
characterize  the  spectral  density  of  a  time  series  based  upon  a  finite  set 
of  time  series  observations.  Without  loss  of  generality,  this  sample 
observation  set  is  tsken  to  be  the  contiguous  set  of  N  measurements  as 
given  by 


x(l),  x(2) ,  ••«,  x(N)  (1.1) 

One  of  the  most  widely  used  spectral  estimation  models  is  obtained  by 
postulating  the  following  autoregressive  (AR)  structure 

x(n)  +  a.x(n-l)  +  •••  +  a  x(n-m)  »  e(n)  (1.2) 

X  B 

in  which  c(n)  is  a  white  noise  time  series  with  zero  mean  and 
variance  oe2.  Our  object  will  be  that  of  modeling  an  underlying  time 
series  (x(n)}  with  the  AR  model  structure  (1.2)  in  which  the  a|(  coefficients 
are  estimated  from  the  given  finite  set  of  observations  (1.1).  This  Is 
readily  achieved  by  applying  the  well  known  one-step  prediction. 

Anm-thorder  one-step  predictor,  by  definition,  estlsuites  the  value 
of  a  random  time  series  using  a  linear  combination  of  the  most  recent 
m  samples.  Namely,  the  sample  x(n)  is  estimated  by  means  of  the  relation¬ 
ship 
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J mchw„o  fadt  fc 


(1.3) 


x(n)  -  -  l  a.  x(n-k) 
k-1 

The  difference  between  this  predicted  velue  and  the  observed  value  x(n) 
over  the  observation  interval  is  called  the  prediction  error  and  is 
specified  by 

e(n)  -  x(n)  -  x(n)  »  <  n  <  N  (1.4) 


or  m 

e(n)  •  x(n)  +  £  a.x(n-k)  m  <  n  <  N  (1.5) 

k-1 


Writing  these  error  expressions  in  matrix  form  yields 
£  -  ic  +  Xa 


(N-m)xl,  and  (N-m)xl  column  vectors,  respect- 


vhere  a_,  e,  and  x  are  m*l 
ively,  given  by 

T 

a  -  [a^,  • • • •  ,  affl] 
e-  [e(m+l),  e(m+2),  •••• 
x  m  [x(nr*-l),  x(m+2),  •••• 


(1.7a) 

e(N)]T 

(1.7b) 

x(N)JT 

(1.7c) 

and  X  is  an  (N-m)xm  matrix  specified  by 


x(m), 

x(nrt-l) , 

...  ,  x(N-l) 

x(m-l) , 

• 

# 

x(m), 

• 

• 

,  x(N-2) 

• 

9 

• 

x(l). 

x(2). 

•••  ,  x(N-m) 

(1.7d) 


where  the  superscript  T  denotes  the  transpose  operation. 

The  a^  coefficients  are  to  be  now  selected  so  as  to  cause  each  of  the 
predictor  error  terms  e(n)  to  be  close  to  zero.  This  selection  process 
will  give  rise  to  the  so-called  optimal  one-step  predictor.  To  achieve 
the  required  objective  of  setting  the  e(n)  to  be  near  sero,  one  typleally 
appeals  to  the  least  squares  method  which  minimizes  a  squared  error 
criterion  of  the  form 

f (a)  -  e*we  (1.8) 
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where  w  is  an  (N-m)x (N-m)  nonnegative  definite  square  matrix.  The  mini¬ 
misation  of  this  quadratic  functional  with  respect  to  the  column  vector  a 
is  straightforwardly  carried  out  and  results  in 


T  T 

XwXa®  ■  X  wx 


(1.9) 


It  can  be  shown  that  the  resulting  power  spectral  density  estimate 
of  the  time  series  (x(n)}  is  then  given  by  [1), 


Sx(w) 


l+a?e~-®W+a0oe” 


(1.10) 


where  the  a^  coefficients  are  obtained  upon  solving  relationship  (1.9). 
Generally  the  solution  of  relationship  (1.9)  requires  on  the  order  of 
m3 (i.e.o(m3))  number  of  multiplications  and  additions  if  that  relation¬ 
ship  is  directly  used.  This  computational  requirement  can  be  excessive 
in  many  real  time  applications.  It  has  been  recently  shown  by  Morf  and 
Lee  [2]  that  this  computational  requirement  can  be  reduced  to  o(m)  by 
slightly  reformulating  the  matrix  X  and  column  vector  x.  In  many  interest¬ 
ing  cases,  fortunately,  the  solution  to  this  modified  system  of  equations 
will  be  close  to  that  of  the  desired  solution  as  represented  by  expression 
(1.9).  In  this  paper,  the  method  which  is  identical  to  the  LMS  algorithm 
of  Morf  and  Lee  [2]  is  presented  with  more  emphasis  on  insightful  develop¬ 
ment. 

This  general  modification  methodology  shall  herein  be  referred  to  as 
data  modification.  Applying  the  specific  data  modification  method  referred 
to  as  prewindowing,  the  matrix  X  is  reformulated  as  the  Nxm  matrix 
given  by 

fo  x(l)  x(2)  •••  x(m)  •••  x(N-l)~|T 


x(l)  •«•  x(m-l)  ."  x(N-2) 


O.'.’O  x(l)  ...  x(N-m) 


(1.11) 


while  the  Nxl  column  vector  x  is  specified  by 


x-  [x(l),  x(2) ,  ,  x(N)] 


(1.12) 


If  these  new  entrants  are  substituted  into  relationship  (1.9),  an 
efficient  solution  procedure  for  a*  is  possible.  The  structure  of  this 
reformulated  matrix  X  and  the  column  vector  x  enables  us  to  obtain  a 
recursive  least  square  spectral  estimation  algorithm  which  has  an 
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excellent  convergence  behavior  and  a  fast  parameter  tracking  capability 
relative  to  the  former  structure.  The  development  of  this  algorithm  is 
predicated  on  the  utilization  of  projection  operator  theory  [3].  In  the 
sections  which  follow  the  necessary  projection  operator  theory  to  be  used 
in  the  algorithm  is  described. 


II.  VECTOR  SPACE  FORMULATION 

.  In  this  section,  the  given  spectral  estimation  problem  will  be  cast 
into  a  convenient  vector  space  setting.  It  will  be  assumed  that  the 
following  observations  of  the  time  series  {x(n))  as  specified  by 


x(l),  x(2) ,  •••  ,  x(N) 


(2.1) 


are  given.  This  in  turn  will  give  rise  to  the  associated  column  data 
vector 


Xjj  -  [x(l),  x(2),  •••  ,  x(N) ] 


(2.2) 


The  vector  lies  in  the  product  space 


RxRx  • • •  x  R  ■  R 


(2.3) 


This  vector  space  can  be  made  into  an  inner  product  space  by  defining  the 
following  inner  product  between  any  two  elements  x^,  6 


>  -  %  “  ^*(n)y(n) 


(2.4) 


The  corresponding  induced  norm  of  x^  is  then  given  by 

II  XNII  “  25*,  >lla  *  ["  l  *2(n>] 

n*l  J 


(2.5) 


We  next  define  the  shift  matrix  S  which  is  represented  by  the  N*N 
matrix 


2  • .  o 


(2.6) 


Applying  the  shift  matrix  m  times  to  the  column  vector  x^  is  seen  to 
yield 
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r  \ 


[0,  •••  ,  0,  x(l), 

V-  ,  -» 

n  zeroes 


x(N-m-l),  x(N-*)JT 


(2.7) 


We  next  construct  the  subspace  Mx„ ^  ^  mj  which  is  spanned  by  the  set  of 
vectors  S^x^,  •  •  • ,  SmxN.  This  subspace  will  be  suggestively  denoted  by 


(S1 


*N* 


Si+1x 

5 


(2.8) 


where  the  first  integer  index  i  may  take  on  any  value  in  the  set 
{0,l,««*,m}.  Next,  ve  let  Px^i  mj  designate  the  projection  operator  on 
the  subspace  MxN[i,m]*  7(118  projection  operator  can  be  shown  to  have  the 
form  _1 


Px..f ,  ,  A  Xx„ , , 

-N[i,mJ  *  — N[i 


,m] 


i,m] 


^[i.m]  ^N[i,m]  ^N(i,m] 


(2.9) 


where  Xxjj  i  >m]  is  the  N*  (m-i+1)  matrix  composed  of  the  following  ordered 
set  of  column  vectors 


^[i.m] 


[S1^, 


S1+1x 


(2.10) 


Similarly,  the  projection  operator  on  the  orthogonal  complement  of  sub¬ 
space  is  denoted  by 


_L 

P^N  [i*ml  *  1  -  P*N[i,m] 


where  I  is  the  N*N  identity  matrix.  It  then  follows  that 
P%[i,m]  *N  *  *N  if  %  6  ^U.m] 

P^[i,m]  In1SS  1  S  k  <  m,  if  H,, 


(2.11) 


(2.12) 

(2.13) 


Expression  (2.12)  and  (2.13)  specify  those  properties  of  the  projection 
operators  which  will  be  utilized  when  developing  a  recursive  least  square 
algorithm  in  the  next  section. 


III.  LINEAR  PREDICTION  AND  PROJECTION  OPERATOR 


In  this  section,  we  will  define  three  methods  of  linear  prediction, 
namely,  forward  prediction,  backward  prediction,  and  delayed  backward 
prediction.  These  projection  operators  will  play  a  central  role  in  the 
algorithmic  solution  procedure  to  be  developed. 
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r*1  ^ 


V 


(a)  Forward  Prediction 


The  m-th  order  forward  prediction  method  is  referred  to  as  that 
specific  procedure  for  estimating  the  column  vector  Xg  by  means  of  a 
linear  combination  of  the  set  of  m  shifted  vectors  (S^xy,  S^*N» *  *  * »sm5N^* 
It  then  follows  that  the  m-th  order  forward  prediction  estimate  of  is 
of  the  form 

*N[l,m]  "  ■J1akS%*  (3'1> 

while  the  associated  forward  error  vector  is  specified  by 
■£«,m  *  -  ^N[l,m] 

*  +  J*kS\ 

k=l 


(3.2a) 

(3.2b) 


1c 

Upon  examination  of  the  structure  of  the  shifted  vector  S  xjj(k *  1, • • • ,m) , 
expression  (3.2b)  leads  to  the  aforementioned  prewindowing  formula  where 
X  and  x  are  given  by  (1.11)  and  (1.12),  respectively. 

The  problem  at  hand  is  to  then  find  the  scalar  constants 
al>  a2»**’»  ajn  which  minimize  the  squared  forward  prediction  error 

f(a)  -  llx,,  II2  (3.3) 


According  to  the  projection  theorem  [4],  f(a)  is  minimized  when  the  error 
vector  is  orthogonal  to  each  of  the  one-dimensional  subspaces  spanned  by 
Sfx^d  ■  1, • • • ,m).  Thus,  we  have  the  orthogonality  relationship  expressed 

by 

(**,  *  2N[l,m])  J-  sl%  for  1  "  1»  2*  ***»  m  <3-4> 

which  takes  the  inner  product  format 

<  >  "  0  i  -  1,  2,  •••,  «  (3.5) 


Substitution  of  expression  (3.1)  into  (3.5)  yields  the  set  of  linear 
algebraic  equations 

k-l  <  S  >  ak  "  ~  <  S%i  >  (3,6) 

for  i  ■  1,  2,  • • • ,  m 
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for  the  optimum  set  of  prediction  coefficients.  These  equations  are 
called  the  normal  equations  and  can  be  put  into  the  matrix  form 


^N[l,m]  ^Nll.mJ  -  "  “^N[l,mJ 


where 


•  *  • 


» 


a  -  [ a^,  a2. 


Solving  equation  (3.7)  for  a  and  substituting  this  solution  into 
expression  (3.1)  then  yields  the  optimum  prediction  vector 


^U.m] 


-1 


(3.8) 


Upon  examination  of  the  projection  operator  (2.  9)  and  this  expression, 
Xjjfl.m]  is  8een  to  compactly  specified  by 


%ll,m)  P%ll,m)  % 


(3.9) 


Thus,  we  see  that  Xiifl.ml  is  obtained  by  projecting  xjj  onto  the  subspace 
Mxil[lftn]  and  the  ra-tn  oraer  forward  prediction  error  vector  is  obtained 
by  projecting  x™  onto  the  orthogonal  complement  of  Nbc^n  mi  in  the  Hu, 
that  is 


•%J,m  *  P^Nll,m] 


(3.10) 


The  corresponding  minimum  mean  squared  error  is  then  defined  to  be 


T 

%,m  ^fl.m 


4,m^ 


(b)  Backward  Prediction 


The  m-th  order  backward  prediction  method  is  that  procedure  of 
estimating  the  m-th  shifted  column  vector  S  xM  by  a  linear  combination 
of  the  set  of  shifted  vectors  (S8x„,  S^x,.,  •••,  This  backward 

estimate  is  then  of  the  form 
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^Nlo.m-l)  ”  bkS  % 


(3.12) 


and  the  backward  error  vector  is  defined  by 


^N,m  ^  ”N  ^N[o,m-l] 


(3.13) 


In  the  same  manner  as  with  forward  prediction,  by  applying  the  projection 
theorem  it  can  be  shown  that  the  backward  estimate  is  given  by 


A  JJJ 

^Nlo.m-l]  *  P*N[o,m-l]  S 


The  backward  prediction  error  vector  is  then  found  to  be 


(3.14) 


^N,m  "  P2EN(o,m-ll  S  ^ 


and  the  corresponding  minimum  mean  squared  error  is  obtained  by 


(3.15) 


f ,  »  b.,  b__  =  b  SV 

N,m  — N,ra  -^N 


(3.16) 


(c)  Delayed  Backward  Prediction 

The  m-th  order  delayed  backward  prediction  method  is  similarly  defined 
to  be  that  procedure  of  estimating  the  column  vector  by  a  linear 

combination  of  the  set  of  vectors  (S^x^,  S^x^,  **•»  S11^} .  It  can  be 
shown  that  the  delayed  backward  estimate  is  given  by 


^Nll.m]  "  P— Njl,m]  S 


and  the  delayed  backward  error  1b  obtained  by 


(3.17) 


j  _m+l 

^N,m  “  P^J[l,ml  S 


The  corresponding  minimum  mean  squared  error  is  measured  by 


(3.18) 


d  T 

f.,  _  -  d„  _  d„  _  -  d, 


T 


EN,m  "  ^N,m  =N,m  "  %,m  S 


(3.19) 
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A  little  thought  will  convince  oneself  that  the  projection 
operation  P£H[l,m]  can  expressed  as 


P£N[1,»] 


XiJN[l,m] 


T 

^N[l,mJ  ^N[l,m] 


T 

^[l.mJ 


O  •  •  •  •  o 

- 

-j 

-1 

O  •  •  s  •  o 

N-l  [a ,  ra-1  J_ 

T 

X^-l[o,m-l] 

^-llo.m-l] 

^N-l[o,m-l] 

(3.20) 


The  relationship  between  the  backward  prediction  error  and  the  delayed 
backward  prediction  error  is  then  readily  found  to  be 


■^N,m 


*N-l,mr 


(3.21) 


It  then  follows  that  Nth  delayed  prediction  error  is  equal  to  the  (N-l)st 
backward  prediction  error 


(3.22) 


The  relationship  of  forward,  backward,  and  delayed  backward  is  suggestively 
depicted  in  [Fig.  1]. 


i 


[Fig.  1]  Forward,  backward  and  delayed  predictions. 
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IV.  DECOMPOSITION  OF  SUBSPACES 


The  development  of  a  computational  efficient  algorithm  is  dependent 
on  the  decomposition  of  subspaces.  Subspaces  may  be  decomposed  by 
appealing  to  the  well  known  projection  theorem  [4].  The  formulae 
obtained  in  this  section  will  be  used  for  the  development  of  order 
update  recursions  in  section  V  . 


Since  the  forward  prediction  error  £^jin  lies  in  the  subspace  Mxnjq 
but  is  orthogonal  to  Mx ^ [ i ^ m ] »  we  can  express  Mx^r  mi  as  the  direct  sum 

0f  ^N[l,m]  and  {— N,m^  *  thlt  is 


Mx  ,  .  =  Mx.,r.  ,  ©  {e„  } 

— N,m[o,mJ  — N[  1  -4lJ,m 


(4.1) 


where  m}  denotes  the  subspace  spanned  by  the  forward  prediction  error 
vector  The  projection  operator  on  the  subspace  (e^  is  defined  by 


Pe„  =  (e„  e.,  ) 

— N,m  — N,m  -^.m  -T^iir 


-1  T 


^N.m 


(4.2) 


Relationship  (4.1)  can  be  readily  shown  to  yield  the  following  decom¬ 
position  of  the  projection  operator 


,  =  (I  -  PeM  )Px^ri  i 
-^N[o,m]  —N,m  — N[l,m] 


(4.3) 


Similarly,  since  the  delayed  backward  prediction  error  dN  m  lies  in 
the  subspace  Mx^^  m+1]  ^ut  is  orth0Bonal  to  ,  we  obtain 


^[l.m+l 


MxmM  ,  ©  {dM  } 
— Nll,mJ  — N,m 


(4.4) 


where  {dj^m}  denotes  the  subspace  spanned  by  the  backward  prediction 
error  vector.  The  projection  operator  on  the  subspace  (djj  m)  is  defined 
by 


T  -IT 

Pci  ,  =  dM  (d  d__  )  dj 

— N,m  — N,m  — N,m  --N,m  — N,m 


(4.5) 


Relationship  (4.4)  is  found  to  yield  the  following  decomposition  of  the 
projection  operator 


Px" 

-N[l,m+1] 


(I  -  Pd„  ) Px.-r ,  , 

— N,m  ^N[l,m] 


(4.6) 


IV-B-20 


V.  ORDER  UPDATE  RECURSIONS 

In  this  section,  we  describe  the  order  update  recursive  formulae 
which  recursively  compute  the  optimum  mflst  order  prediction  error  from 
the  optimum  mth  order  prediction  error.  Expressions  (4.3)  and  (4.6) 
play  a  central  role  in  obtaining  these  order  update  recursions. 

Let  us  first  derive  the  order  update  recursion  for  the  forward 
prediction  error  vector.  Applying  the  projection  operator  (4.6)  to  the 
column  vector  yields 


^N,m+1  "  P^N,m^  %,r 


(5.1) 


Substituting  expression  (4.5)  into  this  relationship  then  yields 

T  _i  T 

^N,m+1  “  ^N.m  “  ^N.m^N.m  ^N,m*  ^N,m  ^N.m 


(5.2) 


Recalling  expression  (3.22),  the  order  update  recursion  for  the  N^ 
forward  prediction  error  is  found  to  be 


'Em  (N)  =  _(N)  -  A„  _  (f„,  J  X  ,  (N-l) 


-=N,m 


N,m+1 v  N-l,m  ^-l,m' 


(5.3) 


where  the  partial-correlation  coefficients  are  specified  by 


T  _  T  x 

TJ.nH-1  =  ^m,N  -ra,N  “  -N[l,m]  b 


Expression  (5.1)  leads  to 


e„  . ,  r„  *  e..  (I  -  Pd„  )e., 
-^■N.m+l  — N,m+1  -H^.m  ■^N.m-^-N.m 


(5.4) 


(5.5a) 


The  recursion  for  the  forward  minimum  mean  square  error  is  similarly 
found  to  be 


fN,m+l  "  fN,m  "  AN,mH*fN-l,m*  AN,m+l  (5.5b) 

Expressions  (5.3)  and  (5.5b)  constitute  the  order  update  recursion 
formulae  for  the  forward  prediction. 

Next,  we  will  find  the  order  update  recursion  for  the  backward 
prediction  error  vector.  Applying  the  projection  operator  (4.3)  to  the 
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V 


column  vector  S 


m+1 


*N  is 


found  to  yield 


^N.nH-l 


(I  -  Pe*  )  d„ 

— N,m  — N,m 


(5.6) 


Substituting  expression  (4.2)  into  this  relationship  results  in 


•^N.nrt-1 


^N,m 


T  T  -1  T 

(^N,m  -^N,m  ^N.m 


(5.7) 


The  order  update  recursion  for  the  Nfch  backward  prediction  error  is  then 
specified  by 


^N,m+1(N)  =  -N-l,m(N_1)  '  Vm+l^N.m*  %,m(N) 


(5.8) 


Expression  (5.6)  leads  to 


T  T 

b„  b„  , ,  *  d„  (I  -  Pe„  )  d.. 

— N,ra+1  — N,m+1  — N,m'  — N,m  — N,m 


(5.9) 


The  recursion  for  f„  is  next  found  to  be 

N,m 


b  b  e  -1 

fN,m+l  =  fN-l,tn  "  ^.m+l^N.m*  AN,m+l 


(5.10) 


The  order  update  recursion  formulae  for  the  backward  prediction  are 
represented  by  relationships  (5.8)  and  (5.10) 


VI.  TIME  UPDATE  RECURSIONS 


As  a  new  element  of  the  time  series  is  observed,  the  partial  re¬ 
flection  coefficients,  forward  least  square  errors,  and  the  backward 
least  square  errors  can  be  computed  recursively  by  using  the  knowledge  of 
these  parameters  from  the  last  time  instance.  This  being  the  case, 
these  parameters  are  said  to  be  "time  updated"  for  each  new  data  point. 
These  update  recursions  are  obtained  by  utilizing  a  method  referred  to 
as  projection  operator  decomposition. 


For  the  spectral  estimation  problem  considered  here,  we  decompose 
the  projection  operator  PxN[i,m]  into  one  that  projects  on  all  past 
observations  and  another  that  generates  the  correction  due  to  a  new 
observation  x(N).  First,  we  define  the  component  projection  matrix  Pjj 
by 


PN  *  eNeN 


(6.1) 
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(6.2) 


where  eu  is  the  N*1  unit  basis  vector  expressed  by 
eN  -  to,  o,  1]T 

Let  us  define  the  column  vectors 

T 

xpN  -  PN  Xjj  «  lo,  •  •  • ,  o,  x(N)]  (6.3) 

xpj*-  m  Pjfxfl  m  tx(l),  x(N-l),  o]T  (6.4) 

Note  that  xp^  ^pN  *  XP^  “  Zpji  and  similarly  for  xp^j  The  pro¬ 
jection  of  x^  on  the  subspace  Mx^r  ^  .  is  now  decomposed  by  component 

projection  matrix  P^  to  obtain  * 


P%ti,m]  3n  "  ^tim]  ^?N  +  P^N[i,mj  &N 


(6.5) 


Multiplication  of  (I-Pjj)  and  the  matrix  Xx^[i,m]  yields  the  so-called 
oblique  matrix 


:^N[i,m]  (I  “  V^NU.m] 


(6.6) 


whose  last  row  is  the  zero  row  vector.  We  define  the  oblique  projection 
operator  to  be 


%[i,m]  ’  ^NU.m] 


-1 


^N[i,m]  %[i,m] 


T 

%[i.m] 


(6.7) 


and  its  associated  orthogonal  complement  by 


(6.8) 


Upon  inspection  of  expression  (6.7),  we  see  that  the  application  of  the 
oblique  projection  operator  to  the  vector  xN  implicitly  possesses  the 
solution  of  the  prediction  coefficients  at  the  N-lst  stage. 

After  simple  algebraic  manipulation,  relationship  (6.5)  can  be 
Expressed  as 

P^N[i,m]  "  <&N[l,a]  +  P*N[i,m]  Vlfal[l,a)  (6,9 
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The  orthogonal  complement  projection  of  Xg  can  be  expressed  aa 


P*NU,ml  ‘  ^[i.m]  '  P*N[i,a]  PN  ^{i.m]  <6*l°*> 

which  can  be  further  developed  to  the  form 

•  P*N[i,m]  %  "  '  %J[i,m]*N  “  PN  ^(i.m] 

+  P^N[i,m]  PN  %l[i,m]  (6.10b) 

Considering  the  relationships  (6.3)t  (6.4)  and  (6.7),  we  obtain 


P4[l,m]  % 


P^N-l[i,m]  %-l 


+  P; 


’4[i,«]  PN  ^[i.m]  *N  (6’U) 


—  I  1  rp 

Premultiplying  [S  xN]  on  both  sides  of  expression  (6.11)  gives  the 
time  update  recursions  of  the  partial  reflection  coefficients 


m+1  T  i  -1 

Am+-1,N  “  Aro+1,N-1  +  lS  P~N{1,»J  PN  ^[l.mJ^N 


(6.12) 


where  i  was  taken  to  be  1.  Furthermore,  operation  of  the  component 
projection  operator  P^  on  both  sides  of  expression  (6.10a)  yields 


1  i  T  T  x 

PN  P^N(i,m]  “  PN  ^Nli.m]  '  eN*N  P^N[i,m]  eNeN  ^[i.m] 


PN  ^N[i,m]  “  eN  P25N[i,mJ  eNJ 


(6.13a) 

(6.13b) 


Thus  we  obtain  the  relationship 


PN  %»[i,m]  "  1  -  Yj  _  N  «  P^N[i,m]^U 

1 1  In  f  PI 


(6.14) 


where 


Yi,m,N  “  eN  P*N[i,m]  eK 


(6.15) 


Thus  we  can  use  equation  (6.17)  to  update  the  partial  reflection 
coefficient.  Equations  (6.18)  end  (6.19)  can  be  used  to  update  forward 
and  backward  prediction  errors,  respectively. 

VII.  SlMtARY 

A  recursive  algorithm  has  been  presented  for  efficiently  obtaining 
an  autoregressive  (AR)  spectral  estimate.  To  achieve  a  significant  com¬ 
putational  improvement,  prewindowing  was  applied,  and  projection  operators 
were  utilized  in  the  vector  space  setting.  Normalizations  of  the  order  end 
time  update  algorithm  yield  more  computational  advantage  than  the  un- 
normslized  method.  Interested  reader  may  refer  to  [2],  (3). 


IV-B-25 


VIII.  REFERENCES 


[1]  S.  Hay kin,  editor,  NONLINEAR  METHODS  OF  SPECTRAL  ANALYSIS 
Springar-Verlag  Sari in  Heidelberg  Nw  York  1979. 

(2]  D.  T.  La*  and  M.  Morf,  RECURSIVE  SQUARE-ROOT  LADDER  ESTIMATION 
ALG0RIT1MS  in  Proc.  1980  IEEE  Int.  Conf.  Acouat.  Speech,  Signal 
Procaaaing,  Danvar,  CO,  Apr.  9-11,  1980,  pp. 1036-1016. 

13]  B.  Friadlandar,  RECURSIVE  ALCORITWIS  FOR  LADDER  FORMS  TECHNICAL 
MEMORANDUM  TM  3334-02,  January  1980. 

[4]  Luenberget,  OPTIMIZATION  BY  VECTOR  SPACE  METHODS,  John  Wiley  &  Sona, 
Inc.  1969. 


